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Topics 


e Informatics 

e Earth Science Informatics (ESI) 
e IEEE GRSS 

e ESI Technical Committee 

e Major “players” in the world 


e NASA’s involvement — Earth Observing 
System Data and Information System 
(EOSDIS) 


e Conclusion 
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NASA’s Earth Science Data Systems 


a “Advance understanding of Earth and develop 
technologies to improve the quality of life on our 
home planet.” -- 2014 NASA Strategic Plan 


=u NASA’s Earth Science Data Systems Program 
directly supports this strategic goal by providing 
end-to-end capabilities to deliver data and 
information products to users 


ge NASA’s Earth Science Data and Information 
Policy promotes usage of data by the community 


¢ In effect since 1990 

¢ No period of exclusive access - Data are available after initial 
checkout 

¢ Data available at no cost to all users on a non-discriminatory 
basis except where agreed upon with international partners 


Core Capabilities and Competed Programs 


u Core Capabilities 
> Basic operational capabilities to process, archive, manage and 
distribute data from NASA missions 
“Earth Observing System Data and Information System (EOSDIS) 
a Competitive Programs 
> Peer-review-selected projects 
> New data products — Making Earth System Data Records for 
Use in Research Environments (MEaSUREs) 
> Research in Earth Science Informatics to feed into the evolution 
of the core components 
“*Applied Information Systems Technology (AIST) 
«*Advancing Collaborative Connections for Earth System Science 
(ACCESS) 
a Core and Competitive Programs collaborate through 
Earth Science Data System Working Groups (ESDSWG) 


Earth Observing System Data and 
Information System (EOSDIS) 


su Development and operation by Earth Science 
Data and Information System (ESDIS) Project 
— NASA Goddard Space Flight Center 


a Operating since August 1994 


=» Provides end-to-end capabilities for 
managing NASA’s Earth science data. 


> Science Operations 
“Science data processing 
«*Data management 
“*Interoperable distributed data archives 
“«*On-line data access services 
«*Earth science discipline-oriented user services 
> Network Data Transport to distributed system 
elements 


Earth Observing System Data and 
Information System (EOSDIS) 


EOSDIS 
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Extensive Data Collection 


> 11,000 data types = 
(collections) —_— 
¢ Land — 
» Cover & Usage 
» Surface temperature 
» Soil moisture 
» Surface topography 
¢ Atmosphere 
» Winds & Precipitation 
» Aerosols & Clouds a * 
» Temperature & Humidity F Landata espe Onda 
» Solar radiation - e 
¢ Ocean 
» Surface temperature 


» Surface wind fields & eel 
Heat flux Credit: NASA Science Mission Directorate 


» Surface topography ¢ Human Dimensions 
» Ocean color » Population & Land Use 

¢ Cryosphere » Human & Environmental Health 
» Sea/Land Ice & Snow Cover » Ecosystems 


Net Primary Productivity is the amount of carbon absorbed by plants minus 
carbon released by plants, measured in grams of carbon per square meter per 
day. Image shows the averages over October 2016, globally. Credits - Image 
made by Reto Stockli, NASA's Earth Observatory Team, using data provided by 
the MODIS Land Science Team. 
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At the top of the atmosphere (TOA), incoming and outgoing radiation determine Earth’s average 
temperature. This image shows averaged net downward TOA radiation from the Clouds and Earth’s 
Radiant Energy System (CERES) instrument from 2001 to 2010. The Southern Hemisphere receives 
more net radiation than the Northern Hemisphere. (Courtesy D. Frierson et al., 2013, Nature 
Geoscience) — accessed through hitps://earthdata.nasa.gov/user-resources/sensing-our- 
planet/rooting-out-rainfall 


Aerosol Size — September 2016 


percentage of small particles 


Aerosol particle sizes — red = small (man made); green = large (natural); yellow = mixed. 
Map based on data from MODIS instrument on NASA’s Terra satellite. 
http://earthobservatory.nasa.gov/GlobalMaps/view.php?d1=MODAL2 M AER RA 
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This image of Aquarius sea surface salinity (SSS) measurements averaged for 2012 shows a global 
color scale of salinity intensity. Warm colors mark stronger salinity values. Values are shown in a 
range between 30 grams per kilogram (purple) and 40 grams per kilogram (red). (Courtesy N. 


Kuring/NASA) — accessed through https://earthdata.nasa.gov/user-resources/sensing-our-planet/salt- 
of-the-sea. 


Physical 
Oceanography DAAC 
Gravity, Sea Surface 
Temperature, Ocean Winds, 
Topography, Circulation & 
Currents 


Distributed Active Archive 


Alaska Satellite 
Facility DAAC 
SAR Products, Sea Ice, 
Polar Processes, 
Geophysics 


National Snow 
and Ice Data 
Center DAAC 
Frozen Ground, 

Glaciers, 
Ice Sheets, Sea Ice, 
Snow, Soil Moisture 
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Land Processes 
DAAC 
Land Cover, Surface 
Reflectance, Radiance, 
Temperature, Topography, 
Vegetation Indices 


Hazardous Weather, 
Lightning, Tropical Cyclones 
and 
Storm-induced Hazards 


Goddard Earth 
Sciences 
Data and 

Information 
Services Center 
Global Precipitation, 

Solar Irradiance, 

Atmospheric 

Composition and 

Dynamics, Global 
Modeling 


Dynamics Data A 


Information 
System 


Space Geodesy, 
Solid Earth 


Atmospheric 
Science Data 
Center 
Radiation Budget, 
Clouds, Aerosols, 
Tropospheric 
Chemistry 


Socioeconomic 
Data and 
Applications 
Center 
Human Interactions, 
Land Use, 
Environmental 
Sustainability, 
Geospatial Data 


Vai 


| Ocean Biology 


DAAC 
Ocean Biology, 
Sea Surface 
Temperature 


Level 1 and 
Atmosphere 
Archive and 
Distribution 
System (LAADS) 
MODIS Level-1 


and Atmosphere 
Data Products 


Oak Ridge National 
Laboratory DAAC 
Biogeochemical Dynamics, 
Ecological Data, 
Environmental 
Processes 


National Aeronautics and Space Administration 


Science Investigator-led 
Processing Systems 


SIPSs perform forward processing 
fo) MJ ¢-lalel-1 gem o)gele |b (e1 tm lale, 
i=) o] coler-t-x-Mel-1t- Mm CoM lalere)g ole) e-1i:) 
algorithm improvements. 


Www.nasa.gov 


Petabytes 


Large & Growing Archive & Distribution Volumes 


20 Cumulative 
Archive Volume 
15 —#— Volume 
Distributed 
—e Cumulative 
10 Archive Volume 
5 
0 
2000 2004 2008 2012 2016 


Fiscal Year 


Petabytes 


Future Archive Growth 


250 —e Cumulative 
Archive Volume 


200 


150 


2000 2005 2010 2015 2020 2025 


Fiscal Year 


EOSDIS Product files Delivered: FY2000 thru FY2016 


1,600 


1,400 


EOSDIS Science Data Products 
Distribution: FY 2000 through FY 2016 


1,200 


NOTE: FY = Fiscal Year; FY 2016 is 
Oct. 1, 2015 to Sept. 30, 2016 


1,000 


800 


Product Distributed (Millions) 


600 


200 


FYOO FYO1 FYO2. FYO3 FYO4 FYOS FYO6 FYO7 FYO8 FYOS9 FYIO- FY11 Fy12)  FY13) sO FY14—s FY15—s FY16 
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Recent and On-Going Developments (1 of 2) & 


= Land and Atmosphere Near real-time 
Capability for EOS (LANCE) 


= Coherent Web Interface: 
http://earthdata.nasa.gov is operational 


¢ Provides a unified view of NASA Earth science data 
system resources 


¢ Consolidates 14 web sites, and provides links to 
various ways to access data and to related external 
sites 
= User Registration System & earthdata 
login — uniform approach to registration 
across and access to EOSDIS 
components 


Recent and On-Going Developments (2 of 2) S 


= Global Imagery Browse Services (GIBS) 


¢ Standards-based, full resolution, interactive 
browse capability 


¢ Accessible from http://earthdata.nasa.gov wiki 
s Unified Metadata Model and Common 
Metadata Repository 
= Big Earth Data Initiative (BEDI) 
=» Preservation Content Specification 
= Digital Object Identifiers 


¢ ESDIS Project is a registration authority (prefix 
10.5067) 


¢ DOI’s assigned to > 50% of datasets 


Land, Atmosphere Near-real-time Capability for EOS 
(LANCE) 


¢ Building on existing EOSDIS elements provides data from AIRS, AMSR, 
MISR, MLS, MODIS, OMI, and VIIRS instruments in near real-time (< 3 hours 
from observation) 


¢ Utilizes software for Standard Science Products, but relaxes requirements 
for ancillary data inputs 


Earth Science Data Operations 


Earth Science Mission Operations 


* High operational availability = 
EOS Spacecraft FI a ee a 
¢ Applications of LANCE Ne 1 wh a/2|8) aca? Por 
. Terra TORSS [iia | iz HTTPS 
data include: ae =o 
Ae b> EDs os) 
—_ Numerical weather & Aqua Aura Ground : " 5 
climate nonacvasa] Savers Eg TEE 
Spacecra oa 3 _ Worldview 
prediction/forecasting = i E 
Suomi NPP | wl g 
— Monitoring of Natural een ty See 
Hazards a © 
GCOM-W1 


ata Set 


— Disaster Relief 


— Agriculture 
— Air quality 
See: hittps://earthdata.nasa.gov/earth-observation-data/near-real-time/about-lance 
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LANCE Latencies 


Cumulative Four Weeks Latency Histogram for LANCE Levels 0, 1, & 2 Products 
(15 January - 11 February, 2017) 


Percentage Granules Process 
Ww > uw fon] 


Over the four weeks indicated above, >98% of near real- 
time data requests were satisfied within 3 hours. 
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a What is the Earthdata Website? 


¢ Sustainable, evolvable, and reliable Website 
representing community needs for NASA 
Earth science data and information. 

¢ Supports collaboration within and between 
organizations, and for development and 
integration of new applications. 

¢« Coherent and comprehensive Web presence 
of the Earth Science Data Systems Program. 


¢ See Earthdata at https://earthdata.nasa.gov/. 


= Benefits of the Earthdata Website: 


¢ Better represents EOSDIS programmatic 
investments and capabilities. 


« Presents data centers clearly as elements 
within a larger system of systems. 


¢ Facilitates multidisciplinary research and data 
integration. 


* Quickly responds to emerging technologies 


¢ Provides a platform for demonstration of 
interoperability throughout all of our systems. 


EOSDIS Evolution: Worldview and 
Global Browse Imagery Services 


GIBS / Worldview Goal: 


To transform how users interact with and discover NASA Earth data; make it visual 


Approach: 

g 
— The Global Imagery Browse Services @ 
(GIBS) provide open access to full > 
resolution imagery derived from NASA | 3 
products to any mapping client and . 
script g 
https://earthdata.nasa.gov/gibs 2 

— Worldview is an open source, browser- 
based client to interactively explore Pm 
GIBS (and SEDAC) imagery and a 


download the underlying data 
https://worldview.earthdata.nasa.gov 
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Global Image Browse Service (GIBS) & 


a Goal: “Parameter Visualizations’ for all 
EOSDIS Imagery; ~400 products available now 

we Standardized access via OGC WMTS / TWMS 
/ WMS / KML 


= Source code for the GIBS OnEarth server and 
Sample code available at the GIBS GitHub site 

= Repository of pre-prepared, hierarchically 
stored imagery to maximize performance for 
“full-resolution” browse 

a Clients can be built to use and display images 
in GIBS — WorldView is an example 
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: = . http://earthdata.nasa.gov/worldview 
Worldview: Reference Client for GIBS ra jiearidats nasa qovaiis 


@) EOSDIS Worldview (Alpha) - Mozilla Firefox = = toe 
File Edit View History Bookmarks Tools Help 
| EOSDIS Worldview (Alpha) | +) ~ 

€ @ NASA (National Aeronautics a... (US t 3. nasa.gov, $ RY ~ Google P t+ ff 


Base Layers 


Corrected Reflectance (True Color) v 
Terra / MODIS 


Corrected Reflectance (True Color) v 
Aqua / MODIS 


~ 


clara rare DPoflartanc.s (7) = Ola 
Overlays 


Cloud Top Temperature (Night) 
Aqua / MODIS 


Fires (Day and Night) 
Terra’ and Aqua/MODIS Fire and Thermal 
Anomalies 


\ — 
2014-06-14 


2013 
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1 12 
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Data Tools 


mw Search and Order Tools (45) 


mg Data Handling (Read/Ingest, Format 
Conversion, Data Manipulation) (31) 


mg Subsetting and Filtering Tools (Temporal, 
Spatial, Parameter, Channel) (34) 


= Geolocation, Reprojection, and Mapping Tools 


a Data Visualization & Analysis Tools (31) 
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Preserving NASA Earth Science Data S& 


Understandability | 


Discoverability \_ | 
& Accessibility _ PRESERVE 


Reproducibility . 
of Results 


Readability 
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Categories of Content to be Preserved (tm 


NASA’s Preservation Content Specification for Earth Science Data 


1. Preflight/Pre-Operations: Instrument/Sensor characteristics including pre- 
flight/pre-operations performance measurements; calibration method; 
radiometric and spectral response; noise characteristics; detector offsets 

2. Science Data Products: Raw instrument data, Level 0 through Level 4 data 
products and associated metadata 

3. Science Data Product Documentation: Structure and format with 
definitions of all parameters and metadata fields; algorithm theoretical basis; 
processing history and product version history; quality assessment 
information 

4. Mission Data Calibration: Instrument/sensor calibration method (in 
operation) and data; calibration software used to generate lookup tables; 
instrument and platform events and maneuvers 

5. Science Data Product Software: Product generation software and software 
documentation 

6. Science Data Product Algorithm Input: Any ancillary data or other data 
sets used in generation or calibration of the data or derived product; ancillary 
data description and documentation 

7. Science Data Product Validation: Records, publications and data sets 

8. Science Data Software Tools: product access (reader) tools. 


Sources of Content 


Mission 
logs 


Science Data 
Product | 
Documentation in ee 
Mission 
——____—_. Data 
Calibration 
: = Science 
Data Software 
Software 2 
Products Tools 
Level 0 
Science Data WA Data 
Ancillary data Product i 
sources (e.g., Algorithm 
NOAA) Input Science 
Data 
Product 
Validation 


Preflight/ 
Pre- —_ 
Operations 
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EOSDIS Technology Improvements 
and System Evolution 


= Federated active 
archives; loosely 


Lessons learned and information technology coupled 
j j U Needs dri 
advances coupled with advice/comments from = [— Coexistence o a User Nesd= driven 
community supports a continuously evolving Ahipgeadaia HETER Te 
F : Seer roviders / M 
data system with growing capabilities interaction partners = peguehory Clacale 
_ Unified Metadata 
a Minimal set of core Model 
standards; support 
a Support for for community- sg Enable user 


high data specific standards registration to 
volume & near- : ; provide persistence 
= Improved line media = Coordinate websites and seemless access 


access to (earthdata.nasa.gov) 
heritage data a Integrated core 


a Discipline/ plus coupled = Preservation — 
mission = Cross-system elements content 
specific data searchand  _ specifications 
systems order access via =u Common data = Open Source 

data model u Reusable software software and use of 


F interoperability : 
a community: P = Expanded m Service Oriented ae 


Dee mode 
specific software tools j : 
standards only = Common and services pigaecie J ISe GV CUTE TEE 
distribution = On-line archives and clougiresCurces 
"proved other formats * support o seceinecnene|  |imastoumecerones 
cumbersome also supported interoperate imagery 
pea toees u Near Real-Time a Ease of innovation 


a lees density data sources access and technology 
offline media infusion 


a Collaboratively 
developed data 
analytics software 


a Offline media 


<1990 Mid-1990s Late 90s + 2000s 2010s + 
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EOSDIS Evolution — On-Going with 
Community Inputs 


a Earth Science Data System Working Groups 
¢ Focus on exploration and development of 
recommendations derived from pertinent community 
insights 
¢ Organized around key technology and information 
system issues 
¢ Members from NASA-funded core and competed data 
system activities 
# Earth Science Information Partners (ESIP) 


¢ Established by NASA in 1998 — now 
sponsored by NASA, NOAA and USGS 

¢ > 120 members — government agencies, 
universities, commercial entities 
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ESIP Collaboration Areas 


Data 
Management 
Training 


Semantic 
Technologies 


Usability 


Examples of ESIP and NASA 


Cloud 
Computing 


Documentation 


Information 
Quality 


Discovery 


Web Services 


Earth Science 


Data Analytics 


VR/AR for 
Science 


Earth Sciences 
Pre-Prints 


ESDSWG Activities 
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Process 


Archive 


Discover 


Access 


Analyze/ 
Visualize 


Publish 


Data 
Stewardship 


Preserve 


NASA ESDS Working Groups 


Cloud 
Computing 


Time Series 


Data Quality 


Search 
Relevance 


Geospatial 
Web Services 


Visualization 


Digital Object 
Identifiers & 
Citations 


Provenance 


Data Intensive 
Architectures 


Map 
Projections 


Airborne Data 
& Metadata 


Dataset 
Interoperability 


Data Recipes 


Users Forum 


Preservation 
Practices 
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Conclusion 


e Earth Science Informatics is a rapidly 
developing discipline 

e Many organizations around the world 
are actively pursuing ESI R & D 

e Considerable commonality of interests 
among these organizations 

« IEEE GRSS ESI TC, ESIP Federation, 
Research Data Alliance (RDA) are 
examples of groups promoting 
collaboration 


si IEEE 


